Research on Energy-Saving Routing Technology Based on Deep Reinforcement Learning
نویسندگان
چکیده
With the vigorous development of Internet, network traffic data centers has exploded, and at same time, energy consumption also increased rapidly. Existing routing algorithms only realize optimization through Quality Service (QoS) Experience (QoE), which ignores center networks. Aiming this problem, paper proposes an Ee-Routing algorithm, is energy-saving algorithm based on deep reinforcement learning. First, our method takes performance plane in software-defined as joint goal establishes energy-efficient scheduling scheme for elephant flows mice flows. Then, we use Deep Deterministic Policy Gradient (DDPG), a learning framework, to achieve continuous goals. The training process Convolutional Neural Network (CNN), can effectively improve convergence efficiency algorithm. After converges, path weights are output, balanced completed. Finally, results show that good stability. Compared with DQN-EER improves saving percentage by 13.93%, compared EARS reduces delay 13.73%, increases throughput 10.91%, packet loss rate 13.51%.
منابع مشابه
Operation Scheduling of MGs Based on Deep Reinforcement Learning Algorithm
: In this paper, the operation scheduling of Microgrids (MGs), including Distributed Energy Resources (DERs) and Energy Storage Systems (ESSs), is proposed using a Deep Reinforcement Learning (DRL) based approach. Due to the dynamic characteristic of the problem, it firstly is formulated as a Markov Decision Process (MDP). Next, Deep Deterministic Policy Gradient (DDPG) algorithm is presented t...
متن کاملResearch on Clustering Based Routing Energy-Saving Technology for Wireless Sensor Network
The clustering routing protocol for wireless sensor network (WSN) is the main part of this study. The number of sensor nodes in WSN is numerous and single node is extraordinarily limited in resource. The most significant aim of designing routing protocol of WSN is to reduce the overall energy dissipated in the network and to maximize the network lifetime. After taking into account the transmiss...
متن کاملReinforcement Learning with Deep Energy-Based Policies
We propose a method for learning expressive energy-based policies for continuous states and actions, which has been feasible only in tabular domains before. We apply our method to learning maximum entropy policies, resulting into a new algorithm, called soft Q-learning, that expresses the optimal policy via a Boltzmann distribution. We use the recently proposed amortized Stein variational gradi...
متن کاملResearch on Energy Saving Potential for Dedicated Ventilation Systems Based on Heat Recovery Technology
Research results have identified the use of heat pipe heat exchangers (HPHXs) for heat recovery as a way to reduce the pre-cooling and re-heating energy. This paper suggests decoupling dehumidification from cooling to reduce energy consumption. The feasible usage and the energy saving potential of heat pipe heat exchanger at the air handler dedicated in accomplishing this objective is investiga...
متن کاملOn-line Building Energy Optimization using Deep Reinforcement Learning
Unprecedented high volumes of data are becoming available with the growth of the advanced metering infrastructure. These are expected to benefit planning and operation of the future power system, and to help the customers transition from a passive to an active role. In this paper, we explore for the first time in the smart grid context the benefits of using Deep Reinforcement Learning, a hybrid...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
ژورنال
عنوان ژورنال: Electronics
سال: 2022
ISSN: ['2079-9292']
DOI: https://doi.org/10.3390/electronics11132035